Adversarial Semantic Scene Completion from a Single Depth Image

We propose a method to reconstruct, complete and semantically label a 3D scene from a single input depth image. We improve the accuracy of the regressed semantic 3D maps by a novel architecture based on adversarial learning. In particular, we suggest using multiple adversarial loss terms that not only enforce realistic outputs with respect to the ground truth, but also an effective embedding of the internal features. This is done by correlating the latent features of the encoder working on partial 2.5D data with the latent features extracted from a variational 3D auto-encoder trained to reconstruct the complete semantic scene. In addition, differently from other approaches that operate entirely through 3D convolutions, at test time we retain the original 2.5D structure of the input during downsampling to improve the effectiveness of the internal representation of our model. We test our approach on the main benchmark datasets for semantic scene completion to qualitatively and quantitatively assess the effectiveness of our proposal.Comment: 2018 International Conference on 3D Vision (3DV

Investigation of Unsteady Tip Clearance Flow in a Low-Speed One and Half Stage Axial Compressor with LES And PIV

The primary focus of this paper is to investigate how a rotor's unsteady tip clearance flow structure changes in a low speed one and half stage axial compressor when the rotor tip gap size is increased from 0.5 mm (0.49% of rotor tip blade chord, 2% of blade span) to 2.4 mm (2.34% chord, 4% span) at the design condition are investigated. The changes in unsteady tip clearance flow with the 0.62 % tip gap as the flow rate is reduced to near stall condition are also investigated. A Large Eddy Simulation (LES) is applied to calculate the unsteady flow field at these three flow conditions. Detailed Stereoscopic PIV (SPIV) measurements of the current flow fields were also performed at the Johns Hopkins University in a refractive index-matched test facility which renders the compressor blades and casing optically transparent. With this setup, the unsteady velocity field in the entire flow domain, including the flow inside the tip gap, can be measured. Unsteady tip clearance flow fields from LES are compared with the PIV measurements and both LES and PIV results are used to study changes in tip clearance flow structures. The current study shows that the tip clearance vortex is not a single structure as traditionally perceived. The tip clearance vortex is formed by multiple interlaced vorticities. Therefore, the tip clearance vortex is inherently unsteady. The multiple interlaced vortices never roll up to form a single structure. When phased-averaged, the tip clearance vortex appears as a single structure. When flow rate is reduced with the same tip gap, the tip clearance vortex rolls further upstream and the tip clearance vortex moves further radially inward and away from the suction side of the blade. When the tip gap size is increased at the design flow condition, the overall tip clearance vortex becomes stronger and it stays closer to the blade suction side and the vortex core extends all the way to the exit of the blade passage. Measured and calculated unsteady flow fields inside the tip gap agree fairly well. Instantaneous velocity vectors inside the tip gap from both the PIV and LES do show flow separation and reattachment at the entrance of tip gap as some earlier studies suggested. This area at the entrance of tip gap flow (the pressure side of the blade) is confined very close to the rotor tip section. With a small tip gap (0.5mm), the gap flow looks like a simple two-dimensional channel flow with larger velocity near the casing for both flow rates. A small area with a sharp velocity gradient is observed just above the rotor tip. This strong shear layer is turned radially inward when it collides with the incoming flow and forms the core structure of the tip clearance vortex. When tip gap size is increased to 2.4 mm at the design operation, the radial profile of the tip gap flow changes drastically. With the large tip gap, the gap flow looks like a two-dimensional channel flow only near the casing. Near the rotor top section, a bigger region with very large shear and reversed flow is observed

ForkNet: Multi-branch Volumetric Semantic Completion from a Single Depth Image

We propose a novel model for 3D semantic completion from a single depth image, based on a single encoder and three separate generators used to reconstruct different geometric and semantic representations of the original and completed scene, all sharing the same latent space. To transfer information between the geometric and semantic branches of the network, we introduce paths between them concatenating features at corresponding network layers. Motivated by the limited amount of training samples from real scenes, an interesting attribute of our architecture is the capacity to supplement the existing dataset by generating a new training dataset with high quality, realistic scenes that even includes occlusion and real noise. We build the new dataset by sampling the features directly from latent space which generates a pair of partial volumetric surface and completed volumetric semantic surface. Moreover, we utilize multiple discriminators to increase the accuracy and realism of the reconstructions. We demonstrate the benefits of our approach on standard benchmarks for the two most common completion tasks: semantic 3D scene completion and 3D object completion.Comment: Accepted in International Conference on Computer Vision 201

Shape, Pose, and Appearance from a Single Image via Bootstrapped Radiance Field Inversion

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has mostly focused on synthetic datasets where exact ground-truth poses are known, and has overlooked pose estimation, which is important for certain downstream applications such as augmented reality (AR) and robotics. We introduce a principled end-to-end reconstruction framework for natural images, where accurate ground-truth poses are not available. Our approach recovers an SDF-parameterized 3D shape, pose, and appearance from a single image of an object, without exploiting multiple views during training. More specifically, we leverage an unconditional 3D-aware generator, to which we apply a hybrid inversion scheme where a model produces a first guess of the solution which is then refined via optimization. Our framework can de-render an image in as few as 10 steps, enabling its use in practical scenarios. We demonstrate state-of-the-art results on a variety of real and synthetic benchmarks

Aqueous Angiography with Fluorescein and Indocyanine Green in Bovine Eyes.

PurposeWe characterize aqueous angiography as a real-time aqueous humor outflow imaging (AHO) modality in cow eyes with two tracers of different molecular characteristics.MethodsCow enucleated eyes (n = 31) were obtained and perfused with balanced salt solution via a Lewicky AC maintainer through a 1-mm side-port. Fluorescein (2.5%) or indocyanine green (ICG; 0.4%) were introduced intracamerally at 10 mm Hg individually or sequentially. With an angiographer, infrared and fluorescent images were acquired. Concurrent anterior segment optical coherence tomography (OCT) was performed, and fixable fluorescent dextrans were introduced into the eye for histologic analysis of angiographically positive and negative areas.ResultsAqueous angiography in cow eyes with fluorescein and ICG yielded high-quality images with segmental patterns. Over time, ICG maintained a better intraluminal presence. Angiographically positive, but not negative, areas demonstrated intrascleral lumens with anterior segment OCT. Aqueous angiography with fluorescent dextrans led to their trapping in AHO pathways. Sequential aqueous angiography with ICG followed by fluorescein in cow eyes demonstrated similar patterns.ConclusionsAqueous angiography in model cow eyes demonstrated segmental angiographic outflow patterns with either fluorescein or ICG as a tracer.Translational relevanceFurther characterization of segmental AHO with aqueous angiography may allow for intelligent placement of trabecular bypass minimally invasive glaucoma surgeries for improved surgical results

Why unidimensional pain measurement prevails in the pediatric acute pain context and what multidimensional self-report methods can offer

Although pain is widely recognized to be a multidimensional experience and defined as such, unidimensional pain measurement focusing on pain intensity prevails in the pediatric acute pain context. Unidimensional assessments fail to provide a comprehensive picture of a child’s pain experience and commonly do little to shape clinical interventions. The current review paper overviews the theoretical and empirical literature supporting the multidimensional nature of pediatric acute pain. Literature reporting concordance data for children’s self-reported sensory, affective and evaluative pain scores in the acute pain context has been reviewed and supports the distinct nature of these dimensions. Multidimensional acute pain measurement holds particular promise for identifying predictive markers of chronicity and may provide the basis for tailoring clinical management. The current paper has described key reasons contributing to the widespread use of unidimensional, rather than multidimensional, acute pediatric pain assessment protocols. Implications for clinical practice, education and future research are considered

Investigation of Unsteady Tip Clearance Flow in a Low-Speed One and Half Stage Axial Compressor with LES And PIV

The primary focus of this paper is to investigate how a rotor's unsteady tip clearance flow structure changes in a low speed one and half stage axial compressor when the rotor tip gap size is increased from 0.5 mm (0.49% of rotor tip blade chord, 2% of blade span) to 2.4 mm (2.34% chord, 4% span) at the design condition are investigated. The changes in unsteady tip clearance flow with the 0.62 % tip gap as the flow rate is reduced to near stall condition are also investigated. A Large Eddy Simulation (LES) is applied to calculate the unsteady flow field at these three flow conditions. Detailed Stereoscopic PIV (SPIV) measurements of the current flow fields were also performed at the Johns Hopkins University in a refractive index-matched test facility which renders the compressor blades and casing optically transparent. With this setup, the unsteady velocity field in the entire flow domain, including the flow inside the tip gap, can be measured. Unsteady tip clearance flow fields from LES are compared with the PIV measurements and both LES and PIV results are used to study changes in tip clearance flow structures. The current study shows that the tip clearance vortex is not a single structure as traditionally perceived. The tip clearance vortex is formed by multiple interlaced vorticities. Therefore, the tip clearance vortex is inherently unsteady. The multiple interlaced vortices never roll up to form a single structure. When phased-averaged, the tip clearance vortex appears as a single structure. When flow rate is reduced with the same tip gap, the tip clearance vortex rolls further upstream and the tip clearance vortex moves further radially inward and away from the suction side of the blade. When the tip gap size is increased at the design flow condition, the overall tip clearance vortex becomes stronger and it stays closer to the blade suction side and the vortex core extends all the way to the exit of the blade passage. Measured and calculated unsteady flow fields inside the tip gap agree fairly well. Instantaneous velocity vectors inside the tip gap from both the PIV and LES do show flow separation and reattachment at the entrance of tip gap as some earlier studies suggested. This area at the entrance of tip gap flow (the pressure side of the blade) is confined very close to the rotor tip section. With a small tip gap (0.5mm), the gap flow looks like a simple two-dimensional channel flow with larger velocity near the casing for both flow rates. A small area with a sharp velocity gradient is observed just above the rotor tip. This strong shear layer is turned radially inward when it collides with the incoming flow and forms the core structure of the tip clearance vortex. When tip gap size is increased to 2.4 mm at the design operation, the radial profile of the tip gap flow changes drastically. With the large tip gap, the gap flow looks like a two-dimensional channel flow only near the casing. Near the rotor top section, a bigger region with very large shear and reversed flow is observed